ABSWACT 


Thi-?  paper  deals  with  an  analysis  of  a  distributed 
model  of  the  game  of  Agossip1^,  in  which  a  message  is  as  ed 
through  a  line  of  indivi  uals,  and  tne  final  (in  general, 
garbled)  result  is  compared  witn  tne  original  ungarbled 
message.  The  deterioration  of  information  (defined  in  the 
sense  of  Shannon  and  Wiener}  along  the  line  is  calculated, 
and  exact  as  well  as  aa, tap  to  tic  formulas  suggest  approximate 
linear  electric  network  analogues.  ( 


I.  Object  of  tois  Paper 

In  discussing  co-rmunicat  on  nets  involving  human 
beings  and/or  other  automata  one  is  te  rted  to  call  upon 
analogies  from  the  theory  of  linear  electric  network  to 
describe  the  mutual  exchange  of  information  on  terms  of 
analogous  current  or  voitage  propagation.  In  this  jraper 
we  consider  a  particular  type  of  communication  system,  ai.d 
inresti'-ate  the  approximations  under  whicn  for  that  particular 
case  an  analogy  can  rigorously  be  drawn,  using  the  strict  definition 
of  i  nforr  at  n  proposed  by  Shannon  and  Wiener 

II.  fhc  Theory  of  Infer :.ation 

Consider  a  c oramunicati on  system  (Fig.  1)  described 
by  the  square  nxn  mat  mix 

P(i,j)«joint  probability  that  the  i^h  swnbol  is  sent,  and, 
as  a  result  of  this,  tne  ;  ^  .-.ymbo]  received. 


(1)  Confer  list  of  references  at  end  or  paper 
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P  (i, j)-a-priori  probability  of  sending  symbol  i. 
JL 

P(i, J)»a-priori  probability  of  receiving  symbol  J. 


^(j)-P  (1#J#)/P  (i 3-conditional  orobability  that  j  is 

recieved  if  i  is  se  it. 

It  is  evidently  necessary  that 

Qt  (J)-l,  (i-l,2,...,n). 

(2) 

Shannon  has  shown  '  '  that  the  information  rate 
of  the  communication  system  of  Fig.  1  should  be  defined  as 
R-H-E,  where 


Q(J)  logQ  (J)  is  the  negentropy  of  the  received  symbols 

173-1  P(i,J,J  logQ^J)  is  the  equivocation  of  the  system. 

In  the  special  case  when  all  the  symbols  to  be  sent 


(3) 


are  e  ,  .ally  likely  we  have 


(2) 

(3) 

U) 

(5) 

(6) 

U) 

(tf) 


P(i)-l/n. 

Therefore,  P(i, J)-(l/n)wi( J),  giving 
E— (l/n)^^^  QjQHog  t  (3). 


(9) 


(103 


(2)  Cf.  ref.  7,  pg.  409;  also  see  ref.  5  for  a  discussion  of 

the  arbitrariness  of  the  choice  of  the  definition  of  infonaation. 
Shan- on  uses  H(y)  for  our  H,  and  Hx(y)  for  our  h.  Shannon 
uses  logs  to  the  base  2;  we  emoloy  natural  logs. 

(3)  The  tenn  "negentropy"is  due  to  Brillouin,  ref.  2. 


> 
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h  J  n 

'w(j)-£^  P  (i)  (j)-  UA)j§  Q^JJ-d/n)  by  (5). 

In  thi»  particular  case,  therefore,  H-logn,  so  that 
R-logn*(l/n)i-^1  Q^JJlogQj^  (j). 

III.  Model  for  the  Game  of  Gossip 

The  game  is  post  lated  to  co  -sist  in  selecting 
a  symbol  (message)  at  random  from  a  set  of  n  symbols,  such 
that  all  n  symbols  are  a-priori  equally  likely,  a  d  propagating 
it  down  the  line  of  individuals.  The  participa-  ts  are  assumed 
to  know  what  the  a-priori  possible  messages  are,  a--d  to  realize 
that  they  are  a-priori  equally  likely. 

Let  x  measure  distance  from  the  beginning,  or 
origin  of  the  lino. 

We  now  make  the  idealizing  pos  ulate  that  jf  the 

th 

symbol  arriving  at  x  is  the  i  symbol,  the'-  the  probability 
that  an  arbitrary  symbol  J  arrives  at  x*dx  is  gi^r.  by  the 
conditional  probability  matrix 


(ID 


(12) 


ii^x,x*dj^ 


l-a(n-l)dx  adx 

adx  l-a(n-l)dx). . . 


l-a(n-l) 


Here  a  should  be  tno  ght  of  as  a  number  orooortional  to  the 
de  sity  of  human  beings  per  unit  distance  a^o  g  the  li  e.  In 
the  realistic  case  distance  would  be  measured  as  proportional  to 
the  number  of  human  beings.  Therefore  a  plays  the  role  of  a 
characteri  tic  frailty  (Independent  of  n)  which  must  be  found 
by  experiment 


Symbolically 

Ql(J)x,x«i*-(1-on<1Jl)  6lJ*l,dx  (5)- 

Let 
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(13) 


fij(x)«c°nditional  probability  that  J  will  be  received  at  x  (I4) 


if  i  is  inserted  at  x»0. 


Then,  using  (13),  (5) 

fiJ(*dx)-^  rik(x)  Qy(J)xlx.dx-f1j')t'-fij(x)  a"dx,adx  (15) 

Thus  fjj(x)  satisfies  the  differential  equation 

fjj  (*)♦  «nfij(x)-a-0  (16) 

The  solution,  with  the  initial  condition  f^j(0)-6^  i® 

(l-.-anX)/n.  (17) 

IV.  Infomation  Flow  In  the  Game  of  Gossip 

According  to  (10),  if  E(x)  is  th“  equivocation  in 

the  stretch  of  line  (0.x), 

E(x)-  -(l/n)1^1  f1j(x)logfij(x).  (1<3) 


(U)  Although  an  exact  solution  for  the  case  of  discrete 

individuals  could  have  been  obtained  the  continous  case 

was  purposely  chosen  because  it  is  simoler. 

(1  if  i-J 

(5)  6..  i*  the  Kronecker  delta:  6.  -  ] 

to  if  i/j 


Substitutir  _  (17),  maripulating  algebraically,  ana  inserting 
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into  (12)  gives  as  the  basic  result 


R  (X)-  !*(■>-»-“  log  [l*  (n-De^J. 


♦  In-] 


-anx> 


a-anxx 
-e  ). 


Hero  H  (x)  is  the  information  available  at  x  regarding  the 
n 

original  pes3age.  A  plot  of  the  function  is  given  in  Pig.  2. 


As  obvious  checks  we  have 


llji  R  (x)-  logn 


X-»0 


lip  R  (x)-0 
n 


R1(x)« 


lip  Rr  (x)»  0  when  x  ^  0. 
n->  ee 


It  is  interesting  to  evaluate  the  derivative 


of  R  (x).  This  is 
n 


R^  (*)-  a(n-l)  e 


-anx 


1.1*  (n-l)  «'<‘rLXJ 


This  shows  that 


(a)  R  (x)  is  strictly  decreasing  as  a  function  of  x 

n 

except  when  a  (n-l)  »  0  in  which  case  R  (x)-  oonst. 

n  — 

(b)  The  slope  of  Rr  (x)  at  the  origin  is  i  finite  w^en  a(n-l)^  0. 
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(25) 

(24) 


(27) 

This  Indict.*  th  t  for  largo  a  if  wo  go  out  o  distance 

l/g(n  -1 )]  from  the  origin  we  will  find  that  the  info  met  ion 
has  deteriorated  to  approximately  37$  of  its  initial  value, 

VI,  Linear  Electric  fretwork  Analogies 

Linear  electric  net-work  analogy  approximations 
can  be  obtained  by  exploiting  either  (26)  or  (27)*  (25)  cannot 

be  used  because  the  xlogx  tern  prevents  it  from  being  the 
solution  of  a  linear  differential  equation  with  constant 
coefficients. 

An  electric  analogy  could  use  either  time  or 
distance  as  the  quantity  analogous  to  x.  If  distance  is 
used,  we  have  the  case  of  an  electric  transmission  line 
with  attenuation.  Recognising  that  a  series  combination 


V.  Estimates  and  Asymptotic  Halations 

The  following  two  relations  are  easily  obtained 

from  (19) i 
For  mall  xt 

2 

R  (x)«logn^a  (n-1)  xlogx  *0  (x  logx), 
n 

For  large  n,  and  ox  larger  than  some  positive  quantity 
independent  of  ns 

R„W-  (3n/2)»"2<mx«0  (•m2anx). 

An  interesting  relation  that  can  also  be 

obtained  is 

R 

11m 
n-e  oo 
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seconds  (time  in  which  the  original  capacitor  voltage  goes 
to  l/eiO.37  of  its  initial  value)  a  simple  lumped  analogy 
making  use  of  (27)  can  be  obtained*  Consider  namely  a 
capacitance  of  value  1  farad  and  leakage  resistance 
fl/a(n-l)j  ohms  (Fig.  3).  If  the  capacita  ce  is  origi  ally 
charged  to  lo,,n  volts  then  the  capacitor  voltage  as  a  fu  ction 
of  time  is  approximately  analogous  to  th*-  irformation  iri  the 
gossip  line  as  a  function  of  cistance. 

Vii.  Supplementary  ^>r.ark 

Of  the  several  possible  modifications  of  the 
pr  ceding  analysis  that  come  to  mind  the  most  obvious 
one  is  the  adoption  of  a  different  ^(j)  x  x^x 
This  will  simply  change  tne  differential  equation  (16), 
but  the  rest  of  the  work  wuuld  be  the  same.  One  possible 
example  is  to  make  a  a  function  of  x.  This  would  reflect 
the  effect  of  rel <tive  position  in  the  grouo  or  the  f-ailty 


of  the  individual 


i 


1. 

2. 
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Fig,  2  Approximate  a  no  logy  for  gossip  line  having 

frailty  per  \!nit  distance  a,  for  case  of  n  possible 
messages.  Here  time  is  the  quantity  analogous  to 
distance  along  the  gossip  line,  and  voltage  is 
analogovm  to  information. 


Fig.  3  Information  along  gossip  line  as  a  function  of  distance 
from  origin. 
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